Self-supervised Learning
Table of Contents
Many images from https://amitness.com/2020/02/illustrated-self-supervised-learning/
Supervised pretraining on large labeled datasets has led to successful transfer learning
ImageNet
Pretrain for fine-grained image classification of 1000 classes
But supervised pretraining comes at a cost …
Self-supervised learning
Pretext Tasks
Solving the pretext tasks allow the model to learn good features.
We can automatically generate labels for the pretext tasks.
Carl Doersch, Abhinav Gupta, Alexei A. Efros, 2015, "Unsupervised Visual Representation Learning by Context Prediction," Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 1422-1430.
Noroozi, M., and Favaro, P., 2016, "Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles," Computer Vision – ECCV 2016, 69–84.
Zhang, R., Isola, P., and Efros, A. A., 2016, "Colorful Image Colorization," Computer Vision – ECCV 2016, 649–666.